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(S7) The technique of the present invention ensure 
output of an Image sut)]ected to image processing, 
which does not depend upon the output environment but 
reflects the cotor reproductioncharacteristics of a shoot- 
ing device and the intention or a photographer in shoot- 
ing. The process geneiHies an image file that Indudas 
pknure data generated by a digkai stilt camera, as weB 
as control data and output specificatton information at- 
tached thereto. The control data controls the details of 
Image processing according to the color reproduction 
characteristics of the camera and the intention of the 
photographer in shooting. The output specification in* 
fomiation specifies, tor example, the address of a print- 
ing device used as an output resource, the type of print- 
ing paper used for printing, and the number of copies. 
The image file is transmfaed to an image processing 
system on a network. The image processing system car- 
ries out image processing of the picture data based on 
the contfol data, generates an output file, and transmits 
the output file to an specified output device via the net- 
work. Even in the environment that can not perform irrv 
age processing based on the control data, the arrange- 
ment of the invention ensures output of the Image thai 
has been subjected to such image processing. 
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Description 

BACKGROUND OF THE INVENTION 
Field ofthf? mention 

[0001 1 The present invention relates to a technique of 
outputling an rnage by utilizing an image file, which in- 
cludes picture data and image processing infonnation 
of the picture data. 

Description of the Related Art 

[0002] As a recent trend, the popular procedure gen- 
erates picture data with a shooting device, such as a 
digital stiH canr>era (DSC), a digital video camera (OVC), 
orascannerand outputs an imageTrom an mr^ge output 
device, such as a CRT. an LCD. a printer, a projector, or 
a TV set. The output image may not accurately repro- 
duce the brightness or the color tone of a siA>iect, due 
to the drfTerence in color reproduction characteristics be- 
tween the shooting device and the image output device. 
Retouching ot picture data is generaly carriedoutto cor- 
rect such a difference in color reproduction. 
[0003] Significant skiH is. however, required for such 
retouching. Adjustment of color reproduction is thus dif- 
ficult, time- consuming and labor-consuming. Some ap- 
plication programs have been proposed to analyze the 
pictuie data and perfonn automatic correction of the 
color tone and the sharpness. But such correction does 
not give the sufficiem result since the characteristics of 
the shooting device are not reflected. In some cases, 
even unnecessary con-ecilon Is carried out against the 
intention ot the photographer in shooting. One applica- 
ble procedure transmits infonnation regarding the char- 
acteristics of the shooting device and the intension c* 
the photographer to the image output device and causes 
the image output device to cany out required coneciion 
based on the transmitted information prior to outpia d 
a resulting image. TWs procedure, however, undesirably 
restricts the output resource to the output emrironmenl 
that can utilize such information. 
{0004] These problems are not intrinsic to ttie shoot- 
ing devices, but similar problems arise in the process pf 
generating picture data by computer graphics. 

SUMMARY OF THE INVENTION 

IPOOS] The object of the present invention is thus to 
provide a technique that ensures output of an image that 
reflects characteristics of a device for generating picture 
data and the intention of an operator who makes the pic- 
ture data without significantly limiting the output envi- 
ronmem. 

[00061 At least part of the above and the other related 
objects is attained by a first image processing system 
of the present invention that is connected with a printing 
device and a shooting device via a network. The printing 



device and the shooting device may be connected to the 
neiwort^ directly or indirectly. In the latter appfcation, for 
exampie, the printing device is locally linked with a com- 
puter connecting to the network. The network may be a 
5 wide area networtc like the Internet or a relatively limited , 
networic like a LAN (Local Area Networic). 
[0007] The image processing system ot the present 
invention carries out image processing on picture data 
and causes the printing device to perfomi printing via 
10 the networit. The pfcture data is associated with image 
processing control data. In one preferable embodiment, 
the picture data and the image processing control data 
can be included in an image file. 
[DOOq In order to actualize the above functions, the 
» 5 image processing system first receives the picture data 
generated toy the shooting device. A digital camera or a 
scanner may be used tor the shooting device. 
[0009] After receiving the pkaure data, the Image 
processing system causes the pcture data to be sub- 
20 jected to image processing based on the image 
processing control data and convereion into a data for- 
mat thai allows supply to the printing devfce. thereby 
generating print data. The converemn includes a cokw 
conversion process, for example, frionfi one cok>r system 
25 of red (R). green (G). and blue IB) used for generation 
ot the pk:ture data to another color system of cyan (C). 
magenta (M), yelow (Y). and black (K) used in the print- 
ing device, as well as a halftoning process. 
[poiO] The image processing system transmits the 
30 print data to the printing device via the networic and 
causes the printing devkxtoprintaresutting image The 
printing device used as the output resource may be set 
In advance or may be specified by the user for each 
printing operation. The ou^ resource may be speci- 
35 tied by informatton representing the locatton of the print- 
ing devtee on the nahwk. for example, address or a 
URJ (Uniform Resource lndk»tof). 
[0011] The user transmits the picture data from the 
shooting dovk« to the image processing system and en- 
40 ables a resulting image to be primed with an arbitrary 
printing devce. Tt\e image processing system carries 
out inage processing based on the image processing 
control data associated with the picture data in the pnx> 
ess ot generating the picture data by the shooting de- 
45 vice. This ensu res the mage processing that reflectB the 
characiertsites of the shooting devtee and the intenston 
of the photographer in shooting. A specificformai of print 
data is applied for data transmission from the image 
procesang system to the printing devtee. This enables 
so printing based on the image processing control data, re- 
gardless of the functions of the printing apparatus. The 
technique of the present invention thus ensures printing 
that reflects the characteristics of ttie shooting devtee 
and the intention of the photographer In shooting without 
55 any limitation of the printing environment 

|001 2] The present invention is also directed to a sec- 
ond image processing system that is connected to an 
image output device via a networic. The image output 
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device is not restncied to the printing device but may be 
a display device, such as a liquid crystal protector or a 
display. 

[O01 3] The second image processing system first re- 
ceives input of picture data and Image processing con- 
troi data used for image processing of the picture data. 
The input of the picture data is not restriaed to input 
from a device that generates the picture data. The pic- 
ture data nnay k^e input not via the network but via some 
medium. The image processing system then causes the 
picture data to be subjected to image processing baaed 
on the image processing control data and thereby gen- 
erates en output data. The image processing system 
transmits the output data to the image output device 
connecting to the network and causes Oie image output 
device to output a resulting image. 
[O014] The arrangement of the second image 
processing system carries out image processing Kiased 
on the image processing control data, regardless of the 
output environment. 

[0018] In the second image processing system, it is 
preferable that the image processing module carries out 
conversion into a data format that allows direct supply, 
to the image output device. This ensures output of a 
processed image without requiring any further process- 
ing in the image output device. When the image output 
device is a printing device, the color conversion and the 
halftoning process discussed pieviously are included in 
this conversion process. The image processing module 
may atternatively transmit output data in a data format 
that enatiles output from the image output device with 
a predetermined series of processing. 
[0016] In the second image processing system, it is 
also preferable that the image processing module se- 
lecth/ely changes the detaQs of the conversion process 
corresponding to the type of the image output device. 
Thia enables output of a processed image to cNverse im- 
age outpU devices. The changeover of the conversion 
process corresponding to the Image output device may 
be based on a users input of Information legarcSng the 
type of the image output device. The image processing 
system may otheniirise fetch the required infomnation 
from the specified Image output device. 
[001 7] Here the type represents a unit that affects the 
contents o1 the conversion. For example, in the case 
where a common format is applied for the format of out* 
put data in a manufacturer of image output devices, the 
type infomnation is the manufiacturer*s name of the ini- 
age output device. 

[0018] The user may indhrkfually specify output style 
from the image output device. In one preferable embod- 
iment, however, the picture data is associated with out- 
put specification information for specifying output style, 
and the image processing system controls the output 
from the Image output device based on this output spec- 
ification infonmation. The output specification infomna- 
tion includes, for example, information for spediying the 
output resource and information regarding the date and 



time of output When a printing device is used as the ' 
image output device, the output specification informa- 
tion may include the size and the type of printing paper 
used for printing and the number of copies. 

5 [0019] In the case where tt\e picture data is defined 
in an YCbCr color space, the image processing carried 
out in the image processing system of the present in- 
vention includes color space conversion from the YCbCr 
color space to an RGB color space. The arrangement 
of executing the color space conversion in the image 
processing system enables the color reproduction char- 
acteristics at the time of generating the image file to be 
kept regardless of the output enviroriment 
[0020] For example, an sRGB color space is typically 

15 used as the RGB color space. Some picture data re- 
quires a wider range of color reproduction than that of 
the sRGB ccrior space. The arrangement of perfonning 
the color conversion in the image processing system en- 
ables the color rsproduaion characteristics to be kept 

so even in such cases. In order to allow the processing in 
a wider range of color reprnduction. it is desirable that 
the color space conversion process includes conversmn 
into a predetermined RGB space having a wider range 
of color reproduction than the sRGB color space. The 
color apace conversion process b not restrictad to the 
conversion into the color space having the wider range 
of color reproduction, but includes a diversity of conver- 
sion pnxresses. for exampte. conversion into a cotor 
space having a relatively narrow larige of cokar repro- 

S0 duction but a high resolution. Ariy of the diverse conver- 
sion processes may be applied selectively. 
IP021] The technk)ue of the presem inventton is actu- 
alized t>y an image processing method and an image 
output method, in addition to the tnnage pr|)cesslng sys- 

35 tem discussed above. The technique of ttie presem in- 
vention is further attained by a computer program that 
utilizes a computer to construct the ima» processing 
system discussed above and t>y a recordirig medium in 
which such a cornputer program is raeorded. Typical ex- 

40 amples of the recording medium include flexible dsks, 
CD-ROMs, magneto-optk: discs, IC cards, ROM car- 
tridges, punched cards, prints with barcodes or other 
codes printed thereon. Internal storage devices (mem- 
ories like a RAM and a ROM) and external storage de- 

45 vices of The conf>uter. and a variety of other computer 
readable media. 

[0022] These and other objects, features, aspects, 
and advantages of the presem invemion will become 
more apparent from the following detailed descr^km of 
so a prefemed embodiment with the accompanying draw- 
ings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
55 [0023] 

Fig. 1 schenrutk»lly illustrates the oonstniction of 
an image oi^ut system in one embodiment of the 
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present Invention; 

Fig. 2 illustrates the stnjcture of a digital still camera 
i 0 used as an image file generation device: and :. 
Rg. 3 is a flowchart showing an image processing 
routine. 

DESCRIPTtON OF THE PREFERRED 
EMBODIMENTS 

[0024] One mode of carrying out the invention is dis- 
cussed below as a preferred embodiment in the foUow- 
ing order 

A. Construction or System 

A1. Siructuie ot image F2e 

A2. Structure of Image Processing System 

B. Structure of Digital Still Camera 

C. image Processing 

D. Effects 

E. Modifications 

A. Cortstruction of System 

[0025] Fig. 1 schematically illustrates ttie construction 
of an image output system in one embodiment of the 
present Invention. The image output system includes an 
tfnage file generation device, an image processing sys- 
tem 100. and an image output device, which are mutu- 
ally connected via a network INT In this embodiment. a 
digital still camera 10 is used as the image file genera- 
tion device. The image file generation device is, howev- 
er, not restricted to the digtlalstiU camera 10 but may be 
any camera device like a digital video camera or a scan- 
ner. Available examples of the image output device in- 
clude a printer PRT a network display DSP, and a liquid 
crystal projector PRJ. The image file generation device 
and the image output device are connected to the net- 
work INT directly orvia a computer In this embodiment, 
the network INT may be a wide area network like the 
Internet or a restricted network like online communica- 
tion or a LAN (Local Area Network). 

Ai. Structure of image Rle 

10026] The image processing system 1 00 is a server 
having the functions of receiving image files from the 
digital still cannera 1 0 and transmtting processed Image 
files to the image output device. A typical structure of 
the image file input into the image processing system 
100 is illustrated in Fig. 1. The image file has a data 
structure, in which picture data with aarfeute intomnation 
mapped ttiereto is stored. In this embodiment, the image 
files adopt a specific fUe structure in confomnity with the 
Exif (Exchangeable Image Pile) format standard for dig- 
ital stilt cameras. The Exit was established by JElOA 
(Japan Eiearonic industry Development Association). 



Although the Exit standard nppliea the JPEG format to 
record the picture data, the image files are not restricted 
to this format. 

[0027] The attribute information includes pieces of in- 
5 fomatran regarding camera conditions, like the dale 
and time of photographing, exposure, and the shutter 
speed, control data of image processing, and output 
specification infomiation. In this embodiment, based on 
the Exit standard, the control data and the output spec- 
10 if ication infomiation among the attrbute information are 
recorded in an area VlakerNoie. The recording area and 
(ts format may be arbitrarily set according to the selected 
format. 

P028] The control data controls the details of image 

IS processing on picture data at the time of putputting an 
image. In this embodiment, the control data mainly in- 
cludes two types of data, that is. a color space param- 
eter and a color correction parameter. 
[0029] The color space parameter is used to transmit 

^ a color reproduction characteristic in the image file gen- 
eration device to tiie image output device and thereby 
actualize precise color reproduction of a subject This 
parameter includes a gamma correction value corre- 
sponding to the characteristic of the image file genera- 

^ tion device and a spec'rfication parameter for the color 
space conversion method. The specification parameter 
for the cobr space conversion method specifies the 
method of color conversion applied for image process- 
ing according to the wkth of the color reproductnn 

30 range by the image file generation device. This emtxid- 
iment uses cok)r spaces of sRGB and NTSC. These two 
cok>r spaces have different color reproductton ranges. 
Applk:aiion of the same color conversion method for im- 
age processing may undesirably narrow the color repro- 

^ duction range of one color space. The ^>ecttk!ation pa- 
rameter is accort£ngly used to specify the adequate 
color conversion method and ensure image processing 
without narrowing the color reproduction range in shoot- 
ing. A diversity of formats may be used for setting the 

40 specification parameter. In this embodinnent. the speci- 
fication parameter determines whch of the sRGB and 
NTSC color spaces is used for shooting. A converston 
matrix used for conversion of the color space may alter- 
natively be set as the specification parctfneter. 

^ [0030] The cotor correction parameter is data used for 
transmitting the intention of tiie photographer to the im- 
age output device. This parameter, for example, In- 
cludes parameters regarding the contrast, the bright- 
ness, the color balance, the saturation, the sharpness, 

^ and the registeredcolor. The registered color represents 
a color used as the referencefor tone adjustment of pic- 
ture data. These parameters arc only illustrative. The 
comrol data may include other parameters or include 
only part of tfie parameters descrfaed above. 

ss [0031] The output specification infoimation functions 
to control the specif ication of output from the image out- 
put device. When the image output devk» is a printer, 
for example, the output specification information speci- 
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fies Ihe size and type of printing paper used for printing, 
the number of copies, and the time required for printing. 
The output specification Information may also include 
address for specifying the output resource and informa- 
tion reganJing the date and time of the output; tt is. how- 
ever, not necessary that the specification of the output 
resource is included in the output specfication informa- 
tion. The output resource may individually be specified 
in the process of receiving picture data from the image 
file generation device. 

A2. Structure of Image Processing System 

[0032] The functional blocks ol the Image processir^g 
system 1 00 are also illustrated in Fig. 1 . The respective 
functional blocks are actuatized by sofrware configura- 
tion In the image processing system 1 00. An input mod- 
ule 101 receives input of image Hies from outside: for 
example, input from the digital sUII canrwra 10 via the 
network or input via a recording medium. 
[0033] The input image file is subiected to image 
processing by an image processing module 102. The 
image processing module 102 exiracts the control data 
tor image processing from the input image fMe and proc- 
esses the picture data based on the extracted control 
data. 

[0034] The output specification irrformation included 
in the Image file is transmitted to a type infomiation 
feichli^ module 103. The type information fetching 
module 103 gains access to each image output device 
based on ttie address for specifying the outpU resource 
included In the otiiput spedfkstlon infomnatlon and 
fetches type informttkm of the image output device. Tt^ 
type information affects the conversion process dte- 
cussed betow, and includes infonmation regarding the 
type of the image output device and information affect- 
ing the image output characteristics of the image output 
device. 

[0038] A data conversion module 1 04 carries out data 
converskKi according to the type of the image output de- 
vice. Nismety the data conversion oiodule 104 converts 
picture data into an adequaie fomnat thai enables trp- 
mediate output from the image output device. When the 
image output devce is a printer, the conversion process 
includes, for example, cotor conversion from RGB into 
CMYK and a halftoning process. The data conversion 
module 104 refers to a type mapping table l04Tto ac- 
tualize the type-based pnx:essing. For example, when 
the image output device is a printer, the type mapping 
table 104T stores information regarding the type of Ink, 
such as dye ink and pigment ink, the number of ink 
colors used for printing, the printing resolution, and the 
conversion table applied for color conversk>n mapped 
to each type processible by the image processing sys- 
tem 100. The image processing system 1 00 can readily 
process newly available printers by updating the con- 
tents of this type mapping table 104T The series of 
processing in the data conversion module 104 may al- 



ternatively be carried out in the image output device. 
[0036] An output tile generation module 1 05 arranges 
the processed data and constructs an output file, which 
is transmittable to the image output devk:e. The data 
5 converted by the data conversion module 104 may be 
specified as the output file, or the converted data with 
part of the output specification informatk>n anached 
thereto may be specified as the output file . The structure 
of the output file for the printer PRT specified as the im- 
10 age output devk:e is also illustrated in Fig. 1 In this ex- 
vTY>le, the output f ile includes print data and the output 
specification information. Here the print data represents 
data converted into a specific format that alk>ws imme- 
tfate printing by the printer PRT. The output specif ca- 
ts tion information is attached to a header or the print data 
in the output file. The attadied output specification In- 
formadon may be. for example, theiype of printing paper 
used for printing and the number of copies. 
10037] A transmission module 106 transmits the out- 
so put file to the image output device via the network IfMT. 
The image output device receives the transmitted output 
file and prints or otherwise outputs a resulting image. 
When the output fSe includes the output specif k:ation in- 
fonnation, the specification of output, for example, 
S5 changeover of printing paper. Is controlled by the output 
spedftoation infonmation. 

B. Structure of Digital Still Camera 

[0038] Ftg. 2 illustrates the structure of the digital still 
camera 10 used as the innage file generation devk». In 
the digftal still camera 10. picture data is generated by 
means of an optical circuit 121 including a CCD for col* 
lecting information of light rays and an image acquisitton 
circuit I22forconverflng.voltage signals df the CCD into 
picture data. 

[0039] The pkrture doia otxained here |s defined In a 
YCk>Cr cok)r space, whk:h is suitable foi^ image com- 
pression based on a JPEG fonnat A (Cerent series of 
processing to obtain pkmjre data in the| YCbCr color 
space from the voltage signal of the CCD is adopted cor- 
responding to the type of the digital still camera 1 0. 
ID040] The digptal still camera 10 genemlly obtains 
picture data defined in the RGB color space from the 
voltage signal of the CCD. An sRGB color space and an 
rfTSC color space are selectively used according to the 
type of the camera. Both the sRGB color space and the 
r^SC color space define cok>r in the RGB coordinate 
system, while the NTSC cok>r space has a wider range 
of color reproduction than the sRGB color space, tn the 
sRGB color space, color is generally defined in the 
range of 6 bits (0 to 255). A cok^r space that extends 
this range to negative values or values of and over 2S6 
(hereinafter referred to as the 'extended sRGB space*) 
S5 nfttiy be used instead of the general sRGB color space. 
Information on the color space used for shooting is in- 
cluded as the color space param^r described previ- 
ously and attached to the picture data as information 
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representing the color reproduction chfiracteristics of 
the digital stili cannera 10. In this enribodiment. the ex- 
tended sRGB space and the sRGB ^ace are in the 
Identical coordinate system and are expressed by the 
same parameters. These two color spaces may alterna- 
tively be expressed in a discrvninative manner from 
each other. 

[0041 ] The 3x3 matrix computation converts the im- 
age obtained in the RGB color space into data in the 
yct>Cr color space. Namely this matrix is used to con- 
vert the RGB coordinate system into the YCbCr coordi- 
nate system . A common matrix is applicable for both the 
sRGB color space and the NTSC color space used for 
shooting. 

[0042] The user operates an operation unit 1 26 to set 
the shooting mode, an Image processing control pararn* 
eter, and the layout. Information requlnod for the setting 
is displayed on an LCD 127. The picture data thus ob- 
tained may be transmiited wirelessly by an aehaJ 125 to 
the image processing system 1 00 via the networli INT. 
The picture data may be recorded rn a memory card MC 
inserted in a memory card slot 1 28. 
[0043] A control circuit 1 24 controls the operations :of 
the digital still camera 10. The control circuit 124 is con- 
structed as a microcomputer including a CPU and mem- 
ories. The furtctional blocks actualized by the software 
conligu ration for such control in the control circuit 124 
are also illustrated in Rg. 2. 

[0044] A picture data input module 11 receives input 
of picture data via a shooting module 12 or an MC input 
module 13. In the case of the shooting module 12, pic- 
ture data is generated by shooting that tJtilizes the opti- 
cal drcuit 121 . In the case of the MC input moduJe 13, 
picture data is read from the memory card MC. 
[0045] A control data setting module 1 4 sets the con- 
trol data included in the image file, in addition to the pic- 
ture data. The control data is used to control the detaBs 
of the Image processing, which is carried out for the pic- 
ture data in the process of outputting the image. The 
user sets the control data, for example, at the dme of 
shooting. An operation input nnxjule 15 and a display 
control module 16 give a user interface for the setting. 
The display control module 16 utilizes the LCD 127 to 
give information to the user, whereas the operation input 
module 15 inputs the operation of the operation unit 126. 
[0046] The user may arbitrarily set each item of the 
control data or select a desirable setting among a plu- 
rality of settings of the control data provided in advance. 
The setting of the control data may be selected, based 
on the relationship to the image output device specified 
as the oittput resource, for example, the type of ink, dye 
Ink or pigment ink, used in the printer specified as the 
output resource and the number of Ink cotors. The se> 
lection may also foe based on the type of the image out- 
put device, tor example, a color printer, a display, or a 
projector. The multiple settings of the control data may 
be mapped to one picture data. 
[0047] An image file generation module 17 specifies 



the mapping of the data from the control datA setting 
module 14to the data from the picture data inputmodule 
1 1 and generates an image f9e. The structure of the Im- 
age file IS discussed previously with reference to Rg. 1 . 

5 [0048] The image file thus generated is output to out- 
side viae transmisatonnDOdule 18 or an MCoutputmod- 
ule 19. The transmission module 18 controls wireless 
communication via the aerial 125. The transimission 
module 18 functions to implement transmission of the 

10 image file to the image processing system 100 via the 
network INT. The MC output module 19 controls writing 
into the memory card MC. The image fOe written in the 
memoiy card MD can be transmitted to the image 
processing ^stem 100 or any other suitable external 
device. 

D. Image Processing 

[0049] Rg. 3 Is a llowchan showing an image 

20 processing routine, which is executed by the image 
processing system 100. The image processing system 
100 first receives input of an image file and specification 
off an output resource at step S10. The image file may 
be transmttted from tfie digital still camera 10 via the 

ss network or read from the memory card MC. The output 
resource is specified by information lite a URI (Uniform 
Resource IncScator) or an IP address representing the 
location of the image output devk» on the network INT. 
in this embodiment, such infonmation is included in the 

30 output spedficaiion infbnnatton In the image file. Alter- 
natively such InformatiDn may be specified by an oper- 
ation of the digital stil camera 1 0 ^ the course of receiv- 
ing the Image file. The image processing system 100 
analyzes the image file and extracts the picture data and 

35 the control data from the input image file. 

[0050] The image processing system 1 00 fetches the 
type information based on the speoficatlon of the output 
resource at step S12. tn the procedure of this embodi- 
ment, the image processing system 100 gains access 

40 to the specified output resource via the network INT to 
fetch the type infonmation. The type information Includes 
infomnation regarding tfie type of the vnage output de- 
vk», for exart^le, a primer, a display, or a scanner, and 
information regarding the name of the nnanufacturer of 

^ the Image output device. When a printer Is used as the 
knage output device, the type information includes in- 
formation regarding the type of ink that is, pigment ink 
or dye ink, used for printing, the nunr^>er of ink colors 
used for printing, and the printing resolution. The ^e 

so infomrtation is utilized in a color conversion process and 
a halftoning process discussed later. 
[0051] The imago processing system 100 subse- 
quently carries out image processing based on the in- 
formation thus obtained. As mentioned previously, In 

55 this emtMdtment. the picture data is defined m the YCb> 
Cr color space. The image processing system 100 thus 
converts the picture data in the YCbCr color apace into 
data in the RGB color space used for shooting at step 
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Si 4. An inversion mfltrix. which is inverse to a matrix 
useil for conversion trom the RGB space to the YCbCr 
space in the digitaJ still camera 10. is applied for this 
conversion This process converts the picture data into 
the data in the color space used for shooting, that is. 
one of the NTSC color space, the sRGB color space, 
and the extendedsRGBcolor space. In the case of con- 
version into the extended sRGB color space, the color 
reproduction range includes negative values and values 
of and over 256. 

[0052] The innage processing system then performs 
gamma correction of the picture data at step Si 6. The 
gamma value used for the gamma correction is included 
in the control data as information representing the char- 
acteristic of the digital still camera 10. 
[0053] After completion of the gamnria correction , the 
innage processing system 100 converts the color space 
of the picture data Into the wRGB color space, which Is 
defined to have the wider color reproduction range than 
the sRGB color space. When the picture data defined 
in either the NTSC color space or the extended sRGB 
color space is processed in the sRGB color space hav- 
ing the narrower color reprtxfuction range, the colors df 
the subject may not be reproduced accurately. From this 
point of view, the picture data generated in the sRGB 
color space may skip a series of processing discussed 
below. In this embodirDent. however, the color space irv 
formation included in the control data does not discrirrv 
inate the sRGB color space from the extended sRGB 
color space. The procedure of this embodiment accord- 
ingly carries out conversion of the picture data ganarat- 
ed in the sRGB color space into data in the wRGB color 
space. Even under such ooncStions, since the pictune 
data in the extended sRGB color space includes nega^ 
tive values or values of or over 256, the extended sRGB 
color space may be distinguished from the sRGB co\6r 
space beised on these tone values. 
[0054] Matrix computation is applied for the conver* 
sron into the wRGB color space. As described previous- 
ly, the Image processing system 100 deals with picture 
data defined in either the sRGB color space or the ex- 
tended sRGB color space and the picture data defined 
in the rsiTSC color space. Matrixes for directly converting 
the picture data in the respective color spaces into data 
in The wRGB color space may be spectfiad. The proce- 
dure of this embodiment, however, carries otil conver- 
sion via a standard XYZ color space. 
[0055] The image processing system 100 first carries 
out conve3ion from the RGB color space to an xyZ 
color apace at step SIB. The conversion process de: 
pends upon ttm color space in which the picture data is 
defined. The procedure of this embodiment accordingly 
provides two conversion matrixes in advarxie, that is. a 
conversion matrix TM1 for the sRGB color space or the 
extended sRGB color space and another conversion 
nrmtrix TM2 for the NTSC color space, and seiectively 
uses one of Ih© two conversion matrixes TM1 and TM2 
to implement conversion according to the color spacje 



used for shooting. The conversion changes the individ- 
ual color ispaces. in wh'ch the picture data is generated, 
into the standard XYZ color space. 
[0056] The image processing system 1 00 then carries 

5 out conversion from the XY2 color space to the wRGB 
color space at step S20. Matra compulation is also ap- 
plied for this conversion. An identical matrix is used for 
this conversion, inrespective of the color space ff\ shoot- 
ing. The matrtc used for the computation may be set ar- 

10 bitrarily according to the definition of the wRGB color 
space. 

[0057] As descrbed above, the picture data obtained 
in the sRGB color space is not required to be converted 
into data in any wider color space, so that the processing 

'5 of steps S 18 and S20 may be skipped . In tnecase where 
the NTSC color space is utilized as the wider color space 
than the sRGB color space, the picture data obtained in 
the NTSC color space may skip the processing of steps 
S 1 8 and 820. The processing of steps SI 8 and S20 can 

20 be omitted aocordirig to the relationship between the 
color space used for shooting and the color space firmlly 
used for the output 

[QOSq After oonnpletion of the color space conversion 
process, the image processing system 100 carries out 

2S inverse gamma correction at step S22. The gamma val- 
ue used here is set. based on the color reproduction 
characteristics of the image output device. In this em- 
bodiment, the Iniage processing system 1 00 receives 
the gamma value from the image output device in the 

50 process of fetching the type infomnaiSon ai step 812. In 
me case where the type of the image output device is 
known at the time of shooting, the type information may 
be Included in the control data attached to the picture 

S5 [0059] The image processing system 100 sii^se- 
quentiy carries out automatic acQustmem of the picture 
quaity to reflect ttie intention of the photographer in 
shooting at step S24. In this embodiment, the aogust- 
ment parameter with regard to. for example, the contrast 

40 is included as the color correction parameter in the con- 
trol data. The Inrwge processing system 100 implements 
automate adjustment of the picture quality, based on 
this parameter. The method of adjusting the picture 
quality based on such a parameter is known in the art 

45 and is thus not specifically descrtied here. 

[0060] This aeries of processing completes the cor- 
rection of picture data that reflects the cok>r reproductkin 
characteristics of the digital still camera 10 and the in- 
tention of the photographer In shooting. The image 

50 processing system 1 00 may output the resulting picture 
data to the image output devk» without any further 
processing. The procedure of the embodiment, howev- 
er, converts the processed pknure data into a specific 
format that alk>ws direct output from the irYiage output 

ss devkse. 

[0061] The details of such conversion are discussed 
betow in an example of the printer as the image output 
device. The image processing system 100 causes the 
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RGB picture data to be subjected to a color conversion 
process corresponding to the type of the printer at step 
326. This process converts Ihe RGB color system into 
the CMYK cotor system used in the printer The conver- 
sion is performed by referring to a conversion lookup 
table (LUT) that maps the colors of one color system 1o 
the colors of the other color system. The procedure of 
this ernbodiment typically uses a conversion table LLTTw 
for conversion of the wRGB color space into the CMYK 
color space. The image processing system 100 also 
stores anotherconversion table LUTsforthe sRGB color 
space. In order to allow processing of picture data de- 
fined in the sRGB cotor space. The Image processing 
system 100 selectively uses the adequate conversion 
table corresponding to the color space in which the pic- 
ture data is defined. The conversion table LUTs may be 
used, for example, when the color space conversion 
process of steps 518 and S20 is sk^ped for the picture 
daia otMained in the sRGB color space and when the 
input knage file is output without any processing for ad- 
justing the F^clure quality. 

[0082] The LUT depends upon not only the color 
space of picture data bul the type of the printer, since 
the type of ink and the number of ink colons may be var- 
ied in each type <^ the primer. The image processing 
system 1 00 thus selectively uses the adequate LUT cor- 
responding to me type of the printer and carries out the 
color conversion process at step S26. 
[0063] The image processing system 100 then carries 
out halftoning of the picture data converted to the torie 
values of CMYK iat step S28. The haffloning process en- 
ables the tone values of picture data to be expressed by 
the density of dots fonned by the printer. Any known 
method like the error diffuston method or the systematic 
dither method may be applied forthe halftoning process. 
[0064] in addition to the above series of processini^. 
the image processing system 100 may carry out a res- 
olution conversion process, which converts the resolu- 
tion of picture data into a printing resolution adopted In 
the printer, and an interlace data generation procasf . 
which sets a data arrangement and feeding quantities 
of sub-scan to enable interlace recording in the printer. 
[0065] The picture data is converted into a specific for- 
mat of print data that enables immediate output from the 
printer through the conversion at steps S26 and S28. 
The image processing system 100 then transmits the 
resulting converted data as the output rile to the speci- 
fied image output device via the network INT at step 
S30. The image output device implements printirig 
based on the transmitted data. 

[0066] At least part of the output spectflcatlon infor- 
mation, in addition to the print data, may be included in 
the output file according to the requirements. For exam- 
ple, the output specificalion information regarding the 
number of copies and the type of printing paper used for 
printing may be irx:luded in the output f Be to ensure out- 
put according to the specificatnn. Arbitrary setting may 
be applied to make tfie output specification information 



included in the output file; for example, the output spec- . 
ification infonnation may be added to the header of the 
print data. 

5 D. Effects 

[0067] In the image output system of the embodiment 
discussed above, the control data includes the color re- 
production characteristics of the image file generetion 

10 device and the intension of shooting to ensure output of 
an image reflecting such spedfication. The image 
processing system 1 00 on the network enables tnr^ge 
processing based on the control data without depending 
upon me output environment, for example, the process- 

rs jng capacity of the image output device. 

[0068] The image output system of the emtediment 
utilizes the image output device connecting with the net- 
work. The user can thus output images from an arbtrary 
image output devce. This arrangement enables images 

•00 . to be output to any third person who is at a remote place. 
The output does not depend upon the output environ- 
ment of the receiver who receives images, but reflects 
the color reproduedon characteristics in shoodng. 
[0060] In the innage output system of the embodiment, 

25 data transmission from the image processing system 
1 00 to the image output devk:e is implemented in the 
specific data format that allows immediate output from 
the image ou^ut device. This advantageously relieves 
the k3ad ot processing in Ihe image output device. 

30 

B, Modlficalions 

10070] The above embodiment regards output of im- 
ages to the printing apparatus. A display or a prDjactor 

3S connecting with the networic may be af^ed for output 
of images. | 
[0071] The diverse series of image processing dis- 
cussed in the above emboCBmera may not be all execut- 
ed in the image processing system 1 00, tuit part of the 

40 image processing may be performed in the image file 
generation devk» or in the image output device. 
[0072] in this embodiment, the image processing sys- 
tem 100 is constructed tiy a single server. The image 
processing system may alternatively include multiple 

45 sen^rs for distributed processing. 

[0073] Although the above embodimem regards ap- 
plication to sfill ptetures, the principle of tfie present in- 
vention is also applicable to nrwving pcture data like 
MPEG. One exemplified procedure adds output control 

so data including image processing comrol data to a mov- 
ing picture file and controls output of all or pan of the 
frames of the moving pk:turc. 

[0074] The above embocfiment and its rTiodiricatk>n8 
are to be considered in all aspects as illustrative and not 
55 restrictive. There may be many modifications, changes, 
and alterations without departing from the scope or spirit 
of the main characteristics of the present inventksn. For 
example, the dh^erse control processes discussed 
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changes over details of the conversion correspond- 
ing to a type of said image output device. 

5. An image processing system in accordance with 
9 dalm 2, wherein the picture data is associated with 
output spedfication infonnation that specifies out- 
put style from said Image output device, and 



above may be attained by the hardware structure, in- 
stead of the software configuration. 
[0075] The scope and spirit of the present invention 
are indicated by the appended claims, rather than by the 
foregoing description. 

Ctoime 

1, An image processing system that carries out image 
processing on picture data. 



said transmission module controls the output 
TO style from said image output device based on 

the output specification information. 



said image processing system being conried- 6. An image processing system in accordance with 

ed with a printing device and a shooting device claim 2, wherein the picture data Is defined in a 

via a network, « YCbCr color space, and 
said innage processing system comprising: 

the image processing includes color space con- 

a receiver ntodute that receives input of the version of the YCbCr color space into an RGB 

picture data generated in said shooting de- color space, 

vice and image processing control data as- ^ 

sedated with the picture data via the net- 7. An image processing system in accordance with 
work; claim 6, wherein Che color space conversion in- 
an image processing module thai causes dudesconverstonintoapredetemiined BGBspace 
the ptoture data to be subjected to image that has a wider range of cok>r reproduction than an 
processing based on the Image processing ss sBGB cok>r space, 
control data and conversion into a data for- 
mat that allows supply to sakj printing d&- 8. An image output method that utaizes an image 
vice, and tliereby generates print data; and processing system connecting with an imgae output 
a transmission module that transmits the device via a networic to output an Image based on 
print data to saki printing device via the net- so picture data, saM image output mettiod comprising: 
worfc and causes said printing device to 

print a processed image. inpuningthe picture data and image processing 

control data associated with the picture data; 

2. An image processing system that carries out Image causing the picture data to be subjected to im- 
processing on piciure data. ^ age processing based on the image processing 

control data, and thereby ger>erating image out- 

an Image input module that receives input of put data; and 

the picture data and image processing control transmitting the image output data to said im- 
data associated with the picture data; age output device and causing said image out- 
an image processing module that causes the ^ put device to output a processed Image, 
picture data to be subjected to image process- 
ing based on the image processing control da- 9. Acomputer program that causes an image process- 
ta, and thereby generates image output data; ing system to output an image to an image output 
and device connecting with said image processing sys- 
a transmission module that transmits the image ^5 tern via a neiwortc, said computer program attaining 
output data to an image output device connect- the functions of: 
ing with said image processing system via a 

network and causes said output devtee to out> inputting picture data and image processing 

put a processed image. control data used for image processing of the 

so picture data; 

3. An image processing system in accordance with causing the picture data to be subjected to im- 
ciaim 2. wherein said image processing module fur- age processing based on the image processing 
ther carries out conversion of the picture data into control data, and thereby generating image out- 
a data format thai alowe supply to sakI image out- put data; and 

put device. 35 transmitting the image output data to said im- 
age output device and causing sakJ image out- 

4. An otiage processing system in accordance with put device to ou^ujt a processed image, 
daim 2, wherein said inrege processing module 
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